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Abstract: A general formulation of the Fokker-Planck-Kolmogorov (FPK) equation for stochastic hybrid 
systems is presented, within the framework of Generalized Stochastic Hybrid Systems (GSHS). The FPK 
equation describes the time evolution of the probability law of the hybrid state. Our derivation is based 
on the concept of mean jump intensity, which is related to both the usual stochastic intensity (in the case 
of spontaneous jumps) and the notion of probability current (in the case of forced jumps). This work 
unifies all previously known instances of the FPK equation for stochastic hybrid systems, and provides 
GSHS practitioners with a tool to derive the correct evolution equation for the probability law of the 
state in any given example. 
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1. INTRODUCTION 

Among all continuous-time stochastic models of (nonlinear) 
dynamical systems, those with the Markov property are espe- 
cially appealling because of their numerous nice properties. In 
particular, they come equipped with a pair of operator semi- 
groups, the so-called backward and forward semigroups, which 
I are the analytical keys to most practical problems involving 
Markov processes. When the system is determined by a stochas- 
tic differential equation, these semigroups are generated by Par- 
tial Differential Equations (PDE) — respectively the backward 
and forward Kolmogorov equations. The forward Kolmogorov 
PDE, also known as the Fokker-Planck equation, rules the time 
evolution 1 1-^ fit, where fit is the probability distribution of the 
state Xt of the system at time t. This paper deals with the gener- 
alization of this Fokker-Planck-Kolmogorov (FPK) equation to 
the framework of General Stochastic Hybrid Systems (GSHS) 
recently proposed by Bujorianu and Lygeros (2004, 2006). 

The GSHS framework encompasses nearly all continuous- 
time Markov models arising in practical applications, includ- 
ing piecewise deterministic Markov processes (Davis, 1984, 
1993) and switching diffusions (Ghosh et al., 1992, 1997). Two 
kinds of jumps are allowed in a GSHS: spontaneous jumps, 
defined by a state-dependent stochastic intensity X{Xt), and 
forced jumps triggered by a so-called guard set G. General- 
ized FPK equations have been given in the literature, in the 
case of spontaneous jumps, for several classes of models; see 
Gardiner (1985), Kontorovich and Lyandres (1999), Krystul 
et al. (2003) and Hespanha (2005) for instance. The case of 
forced jumps is harder to analyze, at the FPK level, because no 



stochastic intensity exists for these jumps. Until recently, the 
only results available in the literature were dealing with one- 
dimensional models; see Feller (1952, 1954) and Malhame and 
Chong (1985). These results have been extended to a class of 
multi-dimensional models by Beet et al. (2006). 

The main contribution of this paper is general formulation of 
the FPK equation for GSHS's. It is based on the concept of 
mean jump intensity, which conveniently substitutes for the 
stochastic intensity when the latter does not exist. This equation 
unifies all previously known instances of the FPK equation 
for stochastic hybrid systems, and provides GSHS practitioners 
with a tool to derive the correct evolution equation for the 
probability law of the state in any given example. The results 
presented in this paper are extracted from the PhD thesis of the 
author (Beet, 2007). 

The paper is organized as follows. Section 2 introduces our 
notations for the GSHS formalism, together with various as- 
sumptions that will be needed in the sequel. In Section 3 we 
define the crucial concept of mean jump intensity, which is 
used in Section 4 to derive our general formulation of the FPK 
equation for GSHS's. Section 5 concludes the paper with a 
series of examples and some general remarks concerning PDEs 
and integro-differential equations. 

2. GENERAL STOCHASTIC HYBRID SYSTEMS 

The object of interest in the GSHS formalism is a continuous- 
time strong Markov process X = {Xt)t>Q, with values in a 
metric space E'^. It is defined on a filtered space {il,A,J^), 
equipped with a system {Px', x E i?*^} of probabihty measures 



on {n,A), with the property that {Xq = x} = 1 for all 
X G (i.e., X starts from x under P^). As usual, denotes 
the expectation operator corresponding to P^. 

It is assumed that, for each lj G SI, the samplepath t -X't(w) 
is right-continuous, has left limits Xjr{Lu) in the completion E 
of E^, and has a finite number of jumps, denoted by Nt{ui), on 
the interval [0; t] for all t > 0. The last condition can be seen as 
a "pathwise non-Zenoness" requirement. We will denote by Tk 
the fc* jump time, with = + (X) if there is less than k jumps. 

2. 1 The hybrid state space 

The (completed) state-space of the model is assumed to have 
a hybrid structure: E = Uggg {q} x Eq, where Q is a finite 
or countable set, and each Eq is either the closure of some 
connected open subset Dq C IR"' (ug > 1) or any singleton 
space (in which case we set Uq = 0). The state at time t can 
therefore be written as a pair Xt ~ {Qt, Zt), where Qt & Q 
and Zt e Eq^. We denote hy Q'^ = {q e Q \ Ug = O] the set 
of all "purely discrete" modes, and by E^ = UggQd {q} x Eq 
the corresponding subset of E. 

The state space E is regarded as the disjoint sum of the sets Eg, 
q E Q, and endowed with the disjoint union topology ^ . We 
denote by £ the Borel a-algebra, and by £c the subsets of 
all relatively compact T €£. Moreover, we define a "volume 
measure" on E by the relation 

m(r) = ^ m,(r nEq)+Y, W , r e f , 

where m, is the rig-dimensional Lebesgue measure on Eq 
and Sx the Dirac mass at x. (Note that Eg C R"' has been 
tacitly identified with {q} x Eg C E.) 

Let dEg be the boundary of Eq in ]R"«, with the convention 
that dEq = when Ug = 0. We define the boundary dE of 
the state space by the relation dE — Uggg {q} x dEq, and the 
guard set by G — E\E". It is not required that G — dE. 

Notations. Let /i : £ ^ ]R be a (signed) measure, K : E x 
£" 1-^ ]R a kernel and (p : E ^ 'E. a measurable function. 
The following notations will be used throughout the paper, 
assuming the integrals exist: {iiK)(dy) = J iJ.{dx) K{x,dy), 
{Kip){x) = J K{x, dy) ip{y) and /xiy? = / iJ.{dx) ip{x). 

2.2 A stochastic differential equation with jumps 

A vector field g on is regarded as a first order differential 
operator with respect to the continuous variables: its action 
on a continuously differentiable function (p G (E) will be 
denoted by g(p, where (g</j)(g, z) = J^"^-^ g'{q, z)^{q, z) on 
E\E^ and gip = QonE^. The number of "components" of g 
depends on the mode q: to simplify the notations, we shall 
agree that the indexes i and j always correspond to summations 
on the number of continuous variables, and drop the explicit 
dependence on q. For instance, the definition of g<^ can be 
rewritten as gf/? = I]j g'^- 

The process X is assumed to be driven by an Ito stochastic 
differential equation between its jumps: there exist r+1 smooth 

^ which is (here) locally compact, separable and completely metrizable 



vector fields f; and a r-dimensional Wiener process B such 
that, in mode qEQ\Q^, 

r 

dZt = {o{q,Zt)dt + Y,HQ,Zt)dB\. (I) 

1=1 

In other words, for all ip G C^{E), X satisfies the following 
generalized Ito formula 

^{Xt)-^{Xo)= [ (L^)(X,)ds + E / {ii'p){X,)dBi 
Jo i^-^ Jo 

+ E ('^(^rJ-V(X-)), 

0<Tfc<t 

where L is the differential generator associated with (1), i.e. 

L = j:ji>£ + 1 Eij (E[=i mi) e^- We make the 
following smoothness assumptions: 

Assumption 1. The drift io is of class C^, and the other vector 
fields fi, 1 < I < r, are of class C^. 

2.3 Two different kinds of jumps 

We assume that there exists a Markov kernel K from E to E^ 

and a measurable locally bounded function \ : E^ ^ R^, such 
that the following Levy system identity holds for all x € E^, 
t>0, and for all measurable : E x E^ —>■ R_,_: 

{ Eo<.,<t 'PiX-,X^,)^ = Ex y\K^){X-) diJ,| 

where {Kp){y) = K{y.dy') (p{y,y') and H is the pre- 
dictable increasing process defined by 

Ht= rA(X,)ds+Elx-eG- (2) 

The first part corresponds to spontaneous jumps, triggered "ran- 
domly in time" with a stochastic intensity X{Xi), while the 
other part corresponds to forced jumps, triggered when X hits 
the guard set G. 

Remark. The terms "spontaneous" and "forced" seem to have 
been coined by Bujorianu et al. (2003). They are closely related 
to the probabilistic notions of predictability and total inaccessi- 
bility for stopping times (see, e.g., Rogers and Williams, 2000, 
chapter VI, §§12-18), but be shall not discuss this point further 
in this paper 

Remark. The pair {K, H) is a Levy system for the process X in 
the sense of Walsh and Weil (1972, definition 6.1). Most authors 
require that H be continuous in the definition of a Levy system, 
thereby disallowing predictable jumps. 

3. MEAN JUMP INTENSITY 

From now on, we assume that some initial probabiUty law hq 
has been chosen, with HoiG) = since the process cannot start 
from G. All expectations will be taken, without further mention, 
with respect to the probabiUty P^o = J HQ{dx)Px. 



3. 1 Definition and link with the usual stochastic intensity 

It is assumed from now on that E{Nt) < + oo. This is a usual 
requirement for stochastic hybrid processes ^ , which is clearly 
stronger than piecewise-continuity of the samplepaths. Its being 
satisfied depends not only on the dynamics of the system but 
also on the initial probability law /xo- 

In order to introduce the main concept of this section, let us 
define a (positive, unbounded) measure Ron E x (0; +cxd) by 

i?(A) = £;,„|^^^^l^(X-,r,)|. 

For any T e£, the quantity R{T x (0; t]) is the expected num- 
ber of jumps starting from F during the time interval (0; t]. 

Definition 2. Suppose that there exists a mapping r : t rt, 
from [0; +00) to the set of all positive bounded measures on E, 
such that, for all F G £, 

(1) 1 1-^ i"t{r) is measurable, 

(2) for all t>0,R{T X {0;i\) = J^* r,(r) ds. 

Then r is called the mean jump intensity of the process X 
(started with the initial law /io). 

Let us spUt R into the sum of two measures i?° and i?*^, corre- 
sponding respectively to the spontaneous and forced jumps of 
the process. Then, using the Levy system identity, it is easy to 
see that a mean jump intensity r° always exist for the sponta- 
neous part R^: it is given by 

r?(F) = £;(A(XO Ix.er) = ^ A(,t) /i,(dx) . 

In other words: for spontaneous jumps, a mean jump intensity 
always exists, and it is the expectation of the stochastic jump 
intensity X{Xt) on the event {X^ e F}. 

Forced jumps are more problematic. The Levy system identity 
is powerless here, since no stochastic intensity exists (because 
forced jumps are predictable). All hope is not lost, though: 
a simple example will be presented in the next subsection, 
proving that a mean jump intensity can exist anyway. This is 
fortunate, since the existence of a mean jump intensity will 
be an essential ingredient for our unified formulation of the 
generalized FPK equation. See subsection 5.2 for further details 
on that issue. 

3.2 Where /xo comes into play: an illustrative example 

Consider the following hybrid dynamics on £^=[0;1]: the 
state Xt moves to the right at constant speed v > as long 
as it is in E° = [0; 1), and jumps instantaneously to as soon 
as it hits the guard G = {1} (i.e., the reset kernel is such 
thati^(l, •) = <5o). 

If we take /Uq = <^o for the initial law, then the process jumps 
from 1 to each time t is a multiple of 1/v, i.e. Tk = k/v 
and X^^ = 1 almost surely. There is therefore no mean jump 
intensity in this case, since R = X]^>i <5(i, fe/u)- 

^ See, e.g., Davis (1984) or Bujorianu and Lygeros (2004). 



Now take /iq to be the uniform probability on [0; 1] (which is, 
incidentally, the only stationary probability law of the process). 
Then 

R(r X (0;i\) = SUV) [ argmaxi^— ^ < t\ dx 

Jo k>l I V J 

= Si{T) I \vt + x] dx 
Jo 

= vtSiir), 

where \vt + x~\ is the smaller integer greater or equal to vt + 
X. Therefore the mean jump intensity exists in this case, and 
is equal to v Si (it is of course time-independent, since /zg 
is stationary). In particular, the global mean jump intensity is 

rt{E) = V. 

4. GENERALIZED FPK EQUATION 
4.1 A weak form of the FPK equation 

Taking expectations in 2.2, the following generalized Dynkin 
formula is obtained: for all compactly supported € C"^ (E) 
and all t>0, 

E {^{Xt) - ^{Xo)} = Ey^{L^){X,)ds^ 

r ° 1 

+eI Yl ^iXr,)-^ix-)\. 

l0<Tfc<t J 

Let us assume the existence of a mean jump intensity rj at all 
times. Then (3) can be rewritten as 

(Mt-Mo)<^= / lJ,s{L(p)ds+ rsiK-I)tpds, (4) 
Jo Jo 
where is the law of Xt and / is the "identity kernel" on E, 
i.e. the kernel defined by I{y, dy') = Sy{dy'). Formally differ- 
entiating (4) yields 

= L*nt+rt{K-I), (5) 

where t ^ ji'^ is the "derivative" of t ^ fit (in a sense to 
be specified later), and L* the adjoint of L in the sense of 
distribution theory. 

Equation (5) begins hke the usual Fokker-Planck equation for 
diffusion processes (/ij = i*/Ut) and ends with an additional 
term that accounts for the jumps of the process. 

Definition 3. We will say that t ^ fit is a solution in the weak 
sense of the generalized FPK equation for the GSHS if 

a) there exists a mean jump intensity 1 1— > r*, 

b) there exists a mapping t ^ fi'^, from [0; -|-oo) to the 
space M.c{E) of all Radon measures on E, such that t ^ 
UtiX) is absolutely continuous with a.e. -derivative t 1— »■ 

/^;(r), foraiir G s^, 

c) is a Radon measure for all t>Q, 

d) equation (5) holds as an equality between Radon mea- 
sures, i.e. ^i(r) = (L>t)(F) + rt{K - I){T) for all 
t > and aU r G fc- 

Such a weak form of the FPK equation is the price to pay for a 
unified treatment of both kind of jumps. Conditions 3. a and 3.b 
can be seen as smoothness requirements with respect to the time 
variable, and 3.c with respect to the space variables. 



4.2 "Physical" interpretation 

The usual FPK equation admits a well-known physical inter- 
pretation as a conservation equation for the "probability mass" 
(see e.g. Gardiner, 1985). Indeed, assuming the existence of a 
smooth pdf p G C'^'^{E x R+), the equation /ij = L*iit can 
be rewritten as a conservation equation dpt/dt = div(jj), with 
the probability current defined by 

Jj = f^^*-JE^' a^^=EfIff- (6) 



1=1 



The additional "jump term" in the generalized FPK equation, 
admit a nice physical interpretation as well. To see this, let us 
rewrite it as the difference of two bounded positive measure: 
rt {K — I) = rf^ — rt, where rf^ = rtK. Therefore rt and rf^ 
behave respectively as a sink and a source in the generalized 
FPK equation: for each F e £, rt(r) At is the probability mass 
leaving the set F during di, because of the jumps of the process, 
while rf'''^(r) dt is the probabiUty mass entering F. 

These two measures are in fact connected by the reset ker- 
nel K(x, Ay). In particular, the relation rt{E) = rf'^{E) holds 
at all times i > 0, ensuring that the total probability mass is 
conserved. Moreover, introducing the measures Wt{Ax, Ay) = 
rt{Ax) K{x, Ay), we have rt = J VF(-,dx), rf'^ = / W{Ax,-) 
and the generaUzed FPK equation can be rewritten more sym- 
metrically as 

fii = L*iJLt + J {Wt{Ax,-)-Wt{;Ax)) . 

It appears clearly, under this form, as a generaUzation of the 

differential Chapman-Kolmo go rov formula of Gardiner (1985, 
equation 3.4.22) — which only allows spontaneous jumps. 

4.3 Sufficient conditions for the existence of a weak solution 

The main result of this paper show that the various requirements 

of definition 3 are not independent. We denote by the total 
variation measure of a Radon measure v, which is finite on £c. 
We shall say that a function t ^ ut from [0; oo) to Mc{E) is 
right-continuous (resp. locally integrable) is t v^ip is right- 
continuous (resp. locally integrable) for all bounded measurable 
f.E^Wi. 

Theorem 4. Consider the following assumptions: 

a) there exists a mean jump intensity r (3. a), such that t^rt 
is right-continuous, 

b) t Ht is different iable in the sense of 3.b, t i-^ fx'^ is 
right-continuous and 1 1-^ l^tl locally integrable, 

c) L* fj,t is a Radon measure for all t > (3.c), t i— > L* jit is 
right-continuous and f ^ \L*fj,t \ is locally integrable. 

If any two of these assumptions hold, then the third holds as well 
and t ^ fjLt is a solution in the weak sense of the generalized 
FPK equation. 

The proof of this theorem is given in appendix A. We will not 
try to give general conditions under which assumptions 4.a-4.c 
are satisfied, since such conditions would inevitably be, in the 
general setting of this paper, very compUcated (involving the 



initial law /xo, the vector fields g of the stochastic differential 
equation, the geometry of the state space E and the reset 
kernel K). 

4.4 The case when a piecewise smooth pdf exists 

Equation (5) is an evolution equation for the measure-valued 
function t ^ /Xf. In most situations of practical interest, the 
measures Ht admit a pdf pt, with respect to the volume mea- 
sure m on i? (sometimes with an additional singular measure, 
like a linear combination of Dirac masses, but this case will not 
be discussed here). If the function p : {x,t) Pt{x) is smooth 
enough, at least piecewise, then equation (5) simultaneously 
gives birth to an evolution equation for t ^ pt and to static re- 
lations that hold for alH > (so-called "boundary conditions", 
although the name is not entirely appropriate here). This can be 
done quite generally, using some additional measure-theoretic 
tools for which there is no room in this paper. The reader is 
referred to Beet (2007, §IV.2.C) for more on this issue. 

5. EXAMPLES 

5.7 A class of models with spontaneous jumps 

Our first series of examples covers a large family of models 
without forced jumps (G = 0). The reset kernel K is assumed 
to satisfy the following assumption: 

Assumption 5. There exists a kernel K* on E such that 
m{Ax) K{x, Ay) = m{Ay) K*{y, Ax) . 

(We do not assume that K* is a Markov kernel, i.e. that K* {y, ■) 
is a probability measure for all y.) The following result is an 
easy consequence of Theorem 4: 

Corollary 6. If there exists a pdf p e C'^'^{E x R+), then 
the measures rt and rf^ are absolutely continuous with respect 
to m, 

Art , Arf^ 



-T— = Xpt. 
dm 



dm 



= K* (Xpt) 



and the following evolution equation holds: 

^ = L*pt + K* (Xpt) - Xpt . 



(7) 



Assumption 5 holds for several classes of models known in the 
literature: pure jump processes with an absolutely continuous 
reset kernel, the switching diffusions of Ghosh et al. (1992, 
1997) and also the SHS of Hespanha (2005). 

Example 7, F'ure jump processes occur when L = 0, i.e. when 
there is no continuous dynamics. We consider here the case 
where K is absolutely continuous: K{x, Ay) = k{x, y) m{Ay). 
For instance, if the amplitude of the jumps is independent of 
the pre-jump state and distributed the pdf p, then k{x,y) = 
p{y — a:). In this case Assumption 5 holds with K*{x, Ay) = 
k{y, x) m{Ay). Introducing the function 7(0;, y) = X{x)k{x, y), 
equation 7 turns into the well-known master equation (Gar- 
diner, 1985, eq. 3.5.2): 



dp 

di 



{y 



>0 = y" {l{x,y)p{x,t) - ^{y,x)p{y,t))m(Ax) . 



In particular, when all modes are purely discrete (ug = 0), this 
is just the usual forward Kolmogorov equation for a continuous- 
time Markov chain. 

Example 8. In the case of switching diffusions, the state space 
is of the form E = Qx R" (with Q a countable set and n > 1) 
and the reset kernel of the form 

where Tr{z) = {Trqq'{z)) is a stochastic matrix for all ^ e R". 
Assumption 5 is fulfilled with K* defined by 

K*{{q,z),-) = E T^q'q{z)^{q',z)- 

q'jiq 

Equation 6 becomes in this case the familiar generalized FPK 
equation for switching diffusion processes (see, e.g., Kon- 
torovich and Lyandres, 1999; Krystul et al., 2003): for all 
X = {q, z) € E andt > 0, 

-g^{x,t) = {L*pt){x) + E K'q{z) Pt{q' , Z) - X{x) Pt{x) , 

'i'¥=q 

where \q'q{z) = X{q', z) T^q'q{z). 

Example 9. The SHS of Hespanha (2005) are also defined 
on E = Q X R", but this time the post-jump state X^^ is 
determined by applying a reset map ^ : E ^ E^ io\he pre- 
jump state X~, \1/ being chosen randomly in a finite of reset 
maps ^'fc. The reset kernel can therefore be written as 

k 

with TTk{x) the probability of choosing the reset map ^I'fe given 
that = X. Provided that the functions are local C^- 
diffeomorphisms, the kernel K fulfills Assumption 5 with 

^*(^'') = X] E '^k{y)\Jk{y)\~'^ 5y, 

where Jk{y) is the Jacobian determinant of '^k at y. Therefore, 
introducing a stochastic intensity Xk = Xgk for each one of the 
reset maps, we recover thanks to Corollary 6 the generalized 
FPK equation given by Hespanha (2005, p. 1364): 

^^{x,t) = {L*p,){x) 

5.2 A class of models with forced jumps 

The measure- valued formulation of the generalized FPK equa- 
tion equation (5) paves the way for an easier proof of some 
recent results (Beet et al., 2006), concerning GSHS with forced 
jumps and deterministic resets. A typical example of this class 
of process is the thermostat model of Malhame and Chong 
(1985). Since a complete statement and proof of these results 
would be too long for this paper, we shall only provide an 
illustrative example. The interested reader is referred to the PhD 
thesis of the author (Beet, 2007, IV.2.C and IV.3.C). A thorough 
treatment will appear in a forthcoming pubUcation. 



Example 10. Let us consider a GSHS without spontaneous 
jumps (A = 0), whose hybrid state space is defined by Q = 
{0,1}, Eo = [z^in;+oo) X ]R"-\ and Eq = (-ooi^max] x 
]R"-i (where z^in < Zmax)- Assume that the guard G is the 
whole boundary dE, and that the reset map is defined by 
\E'((7, z) = — z). In other words, the discrete component Qt 
switches from to 1 when Z} reaches the lower threshold Zmin, 
and switches back to when reaches the upper thresh- 
old Zmax. 

For such a hybrid structure, it is easily shown using Theorem 4 
that no C^'^ solution can exist. Consider the set G" = ^'(G'), 
which is the disjoint unions of two "hyperplanes" in E'^. A 
careful examination of (5) suggests to look for solution that are 
of class C^'^ on \ G', possibly with a discontinuity on G' . If 
the process effectively has a pdf p satisfying these assumptions, 
then it can be proved using Theorem 4 that: 

(1) The usual Fokker-PIanck equation, dpt/dt = L*Pf, holds 
on the four components of E'^ \G', 

(2) The jumps are accounted for by the static relation = 

o ip on G, at all times t > 0, where and are 
the outgoing and ingoing probability current, respectively 
defined on G and G' (see (6) for the defintion of the 
probability current). 

(3) The mean jump intensity rt is supported by G and given 
by the outgoing flux of the probabily current jj, i.e. 
'^t (r) = /rnG where s is the surface measure. 

(4) Finally, for each x & G such that at least one of the "noise 
driven" vector fields g; (1 < / < r) is transverse to G, 
the pdf has to satisfy the so-called absorbing boundary 
condition Pt{x) = 0. For similar reasons, pt has to be 
continuous at each x € T such that at least one of the 
"noise driven" vector fields is transverse to G'. 

5.3 A remark concerning PDEs 

Notations can be deceiving, sometimes. The compact formula- 
tion of (5) and (7), which makes them look very much like the 
usual Fokker-PIanck equation, should not fool the reader into 
thinking that these equations are simple PDEs. Indeed, even 
when a (piecewise) smooth pdf exists, the generalized FPK 
equation is in general a system of integro-differential equa- 
tions, with boundary conditions that can also involve integrals. 
The integrals are hidden in the kernel notation: {rtK){T) = 
J rt{dx)K{x,T). Fortunately, they disappear in many inter- 
esting examples where the reset kernel is simple enough (see 
examples 8-10). This is an important observation for practical 
applications, since the numerical solution of a PDE is much 
easier than that of a general integro-differential equation. 

Appendix A. PROOF OF THEOREM 4 

Let C^{E) denote the set of all compactly supported ip G 
G'^{E). The following lemma is an easy consequence of the 
smoothness of the vector fields: 

Lemma 11. For all ip e G'^{E), t Jq{L* ^s){'fi) is 
differentiable on the right, with the right continuous derivative 
t ^ (i>t)(^). 



In the sequel, "right continuous" is abbreviated as "rc". 

o Assume that both 4. a and 4.b hold. Then each term of (4) 
has a t-derivative on the right. Differentiating both sides proves 
that (5) holds for all t >0, hence that L*/^* is a Radon measure 
and that t ^ L*^t is rc. Moreover, integrating the inequality 

\L*IJ't\ < lA^il + 2ri yields that, for all T £ S^, 

I |L>,|(r)ds< / y,\{Y)ds + 2E{Nt]<+^. 
Jo Jo 

Therefore t |i*/Us | is locally integrable, which proves 4.c. 

o Assume now that 4. a and 4.c hold, and set //' = L*fit + 
rt {K — I), for all t>Q. Clearly, /x^ is a Radon measure, t ^ 
is rc and 

/ M;^-(Mt-MoV, Vt>0, ^^&Cl{E). (A.1) 
Jo 

Moreover, for all F G fc, 

/ |M;i(r)ds< / \L* ^is\{V)ds + 2 E{Nt] <+oo, 
Jo Jo 

which shows that t is locally integrable. Therefore, 

using standard approximation techniques and a monotone class 

argument, it can be proved that (A.l) still holds for ip = Ir, 

T G £c, i e. that t iJ,[ is the "derivative" of t fit in the 

sense of definition 3.b. 

o Finally, assume that 4.b and 4.c hold. Then, for all S 
C^{E), equation (4) can be rewritten as 

jj ip{x) {R'^{dx,ds) - {L*i^,,){dx)ds) 

Gx]0;t] 

= JJ ^(x) {{R^K)idx,ds)-Udx)ds) , (A.2) 

EOx]0;t\ 

where = /i^, - (L>,)(£;0 n •) - r"{K-I). The mea- 
sures R"^ and have been defined in subsection 3.1. Clearly, 
G Mc{E) and 1 1— > is locally integrable. Using once more 
standard approximation techniques, one can prove that (A.2) 
stiU holds when = Ip, with F a compact subset of G. In this 
case the right-hand side vanishes, yielding 

i?«(Fx]0;t]) = / (LV,)(F)ds. 
Jo 

Moreover, since t i— > _R'^(Fx]0; t]) is increasing and t i-^ 
(L*Att)(r) is rc, we have (L*Att)(F) > for all t > 0. This 
allows to extend (A.2) to all F e £c, using a monotone class 
argument, thus proving the existence of a mean jump intensity 
rf = {L*iis){G n • ) for the forced jumps. 
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